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THE MAILING DATE OF THIS COMMUNICATION. 
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DETAILED ACTION 
Arguments and Amendments 
1. Applicant's amendments and arguments filed 12 May 2005, have been entered and made 

of record 



Drawings 

2. The replacement drawing has been received and placed in the file. The drawing is 
accepted. 



Claim Objections 

3. In view of Applicant's amendments, the previous claim objections are withdrawn. 



4. The following sections of 37 CFR § 1 .75(a) and (d)(1) are the basis of the foUowmg 
objection: 



(a) The specification must conclude with a claim particularly pointing out 
and distinctly claiming the subject matter which the applicant regards as his 
invention or discovery. 

(d)(1) The claim or claims must conform to the invention as set forth in 
the remainder of the specification and the terms and phrases used in the 
claims must find clear support or antecedent basis in the description so 
that the meaning of the tmns in the claims may be ascertainable by 
refer^ce to the description. 



5. Claims 1-19 are objected to under 37 CFR §1. 75(a) and (d)(1) as failing to particularly 
point out and distinctly claim the subject matter that the applicant regards as the invention. 
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The last line of claim 1 recites, "of the fragments Fi." As best understood, "Fi" only 
refers to one fragment. Therefore, it appears that the above phrase should be rewritten as "of the 
fragments Fi and Fj" to denote that the inverse mean is take of two fragments rather than just a 
single fragment. Correction and/or clarification of this limitation is required. 

Response to Amendments and Arguments 
6. Applicant has amended claim 1 to denote that C is a "factor consistent Avith the inverse of 
a mean number of pixels of the fragments." In the Examiner's opinion, this change is insufficient 
to distinguish from the previously applied Haris reference. 

As stated in the prior Office action, Haris discloses C being equivalent to (||R*^m|| + 
||R**m||), which is the sum of the cardinality of fragments Ri and Rj. The cardinality of a set is 
simply the number of elements in the set, therefore (HR'I'mII + ||R*^m||) represents the aggregate 
number of pixels in the two fragments. 

Applicant argues that this aggregate value of pixels is not consistent with a mean number 
of pixels. Examiner respectfully disagrees. The mean value of elements between two groups of 
elements is equivalent to the aggregate number of elements divided by two. Therefore, the 
aggregate value is equal to the mean value multiplied by a known scalar value. The aggregate 
and mean values are considered to be consistent with each other because they are directly 
proportional with each other by a factor of two. 

The Specification states, "C is consistent with the inverse of a number of pixels" 
(paragraph [0100]). Then in the next paragraph, the Specification describes how preferably C is 
the mean value of the two fragments Fi and Fj (paragraph [0101]). The Specification suggests 
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that C being "consistent with a number of pixels" means that the value C is directly proportional 
to a number of pixels and thus may include the mean value of a number of pixels. The converse 
is also true in that the mean number of pixels is consistent with the aggregate number of pixels. 
A suggested correction is to denote that "C is the inverse of the mean number of pixels of the 
fragments Fi and Fj" rather than C being merely consistent with the mean number of pixels. 

Claim Rejections - 35 VSC§102 

7. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent iinless - 

(b) the invention was patented or described in a printed pubhcation in this or a foreign country or in pubUc use or on 
sale in this country, more than one year prior to the date of apphcation for patent in the Uoited States, 

8. Claims 1-6 are rejected under 35 U.S.C. 102(b) as being anticipated by "Hybrid Image 
Segmentation Using Watersheds and Fast Region Merging" by Haris et al. ("Haris"). 

Regarding claim 1, Haris discloses a method for the fragmentation of images into 
homogeneous regions, this fragmentation using iterative merges of fragments Fi and Fj (i.e. two 
regions R* m and R*^m) which are as similar as possible according to at least one selection 
parameter, this similarity being evaluated by a product A*B of two factors A and B (see equation 
(12), page 1689), A being consistent with a number of pixels (A = ||R\|| * ||R**m|| ) and B being 
consistent with the selection parameters (B = [iidlR^H) - (||R*^m||)]^ ), characterized in that a 
merge is performed when the product A*B*C is less than a threshold consistent with the 
selection parameter, C being a factor consistent with the inverse of a mean number of pixels of 
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the fragments (C = 1 / (HR^H + ||R**m||), which is directly proportional to the inverse of the mean 
number of pixels and is therefore consistent the inverse of the mean number of pixels). 



Regarding claim 2, Haris discloses that C is proportional to 2/Nm where Nm represents a 
mean size of the fragments Fi, such as a mean number of pixels (i.e. C represent the inverse of 
the sum of the cardinality of sets R**m and R**m and is proportional to the inverse of the mean 
number of pixels). 

Regarding claim 3, Haris discloses the selection parameter(s) is (are) at least luminance 
(i.e. the luminance Y is used in the calculation of B). 

Regarding claim 4, Haris discloses that each iterative merge relates only to two 
neighbouring fragments Fi and Fj ( /(i,j) in equation (12) shows that the merge only relates to 
adjacent regions). 

Regarding claim 5, Haris discloses that the factor A is proportional to the claimed 
equation (i.e. A = ||R*'m|| * ||R**m||, which is proportional to the given equation). 

Regarding claim 6, Haris discloses that the size of a fragment is the number of pixels 
included in this fragment (i.e. the size of each region is the cardinality of the region - that is, the 
number of pixels in the region). 
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Claim Rejections - 35 USC§103 

9. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

10. Claim 7 is rejected under 35 U.S.C. 103(a) as being unpatentable over Harris in view of . 

Regarding claim 7, Haris discloses that the factor B is proportional to (Yi - Yj)^, where 
(Yi - Yj) represent the difference between the luminances of each of these two fragments (see 
equation (12), page 1689). 

Haris does not disclose that the U and V components are utilized because Haris' 
disclosure is in terms of a greyscale image. 

Moed discloses an image segmentation system that operates on a color image. In 
particular, Moed teaching utilizing the YTJV color format to segment an image, and the 
segmentation algorithm involves generating Y, U, and V difference information. See column 4, 
lines 18-48. 

It would have been obvious to one of ordinary skill in the art at the time of the invention 
to modify Haris by Moed to segment a color image in the YUV format and utilize the squared 
difference of the U and V channels, since Moed discloses that it is conventional to perform color 
segmentation on YUV images. 
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11. Claims 8 and 19 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
"Matching Error Based Criterion of Region Merging for Joint Motion Estimation and 
Segmentation Techniques" by Schiitz et ai. ("Schutz") in view of Haris. 

Regarding claim 8, Schiitz discloses a method of grouping fragments of an image (i.e. 
regions), characterized in that this grouping uses a model of motion individual to each fragment 
Fi (§ 3 - the motion M of each region is estimated and used to group, or merge, the regions 
together), this model of motion is determined with a known error or variance so as to allocate to 
the fragment created by this grouping one and the same model of motion (§ 4 - the motion of 
model for each grouped (merged) region is determined with the known mean absolute error 
(MAE) of the regions previously computed), grouping together at each step of this method the 
fragments Fi and Fj which minimize a grouping cost proportional to an evaluation of the 
difference between the models of motion of the two fragments Fi and Fj (§ 3 - the difference in 
the motion models, Ma and Mb, of two regions, A and B, is determined on the basis of the mean 
absolute error (MAE); § 4 - the MAEs between each pair of regions are evaluated to determine 
which adjacent regions exhibit the lowest merging cost, and then those regions whose grouping 
costs were determined to be smallest are merged). 

Schiitz discloses that the initial regions are obtained by a spatial watershed segmentation 
(see § 2). 

However, Schiitz does not disclose that the initial fragments (regions) are obtained 
according to the method of claim 1 . 
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Haris discloses the method of spatial segmentation according to claim 1. It would have 
been obvious to one of ordinary skill in the art at the time of the invention to modify Schiitz by 
Haris to create the initial segmentation according to claim 1, since Schiitz discloses that the 
initial segmentation of the regions is accomplished through a spatial watershed segmentation 
algorithm, and Haris shows that a watershed segmentation that enq)loys the details of claim 1 is a 
conventional way of spatially segmenting an image into homogeneous regions. 

Regarding claim 19, Schiitz discloses the stopping condition is given by a minimal 
threshold (see § 4). 



Allowable Subject Matter 

12. Claims 9-18 are objected to as being dependent upon a rejected base claim, but would be 
allowable if rewritten in independent form including all of the hmitations of the base claim and 
any intervening claims. 

Regarding claim 9, Schiitz does not disclose: (1) that the grouping cost is inversely 
proportional to a threshold of motion, or (2) that in the absence of any other stoppage test, the 
grouping is not allowed if the evaluation is greater than this threshold. Rather, Schiitz teaches 
determining the grouping costs between each pair of adjacent regions and merging regions that 
have a minimal cost (see § 4). 

Regarding claim 11, Schiitz does not disclose the claimed details of the delta equations 
that are used to calculate the evaluation of the difference of motion between two fragments. 

Regarding claim 18, Schutz is silent to the claimed stoppage test formula. 
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Conclusion 

13. TfflS ACTION IS MADE FINAL, Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1. 136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1 . 136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Colin M. LaRose whose telephone number is (571) 272-7423. If 
attempts to reach the examiner by telephone are unsuccessful, the examiner's supervisor, Amelia 
Au, can be reached on (571) 272-7414. The fax phone number for the organization where this 
apphcation or proceeding is assigned is (703) 872-9306. (After July 15, 2005, the fax number 
will be changed to (571)-273-8300.) Any inquiry of a general nature or relating to the status of 
this application or proceeding should be directed to the TC 2600 Customer Service Office whose 
telephone number is (571) 272-2600. 

Information regarding the status of an apphcation may be obtained from the Patent 
Application Information Retrieval (PAIR) system Status information for pubhshed appUcations 
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may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 
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